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different selection 
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Why not just get a price? 

^Capability based scope - lack of clarity 
>Tight budget but flexible approach to 
capability delivery 

>Historical cost over-runs and late delivery 
>Not a 'normal' high CAPEX military 
programme. 
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Promises Promises 




>Past performance 




>Ability to work as part of a team 




> Design for support 
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Good Business 




>Profit 




>Reputation 




>Support to the armed forces 




>Future business 
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Evaluation tools 




>Hard - capability 




>Soft - behavioural 




>Cost of bidding 
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Capability 




• PQQ 

• Questions 

• Marking 

• feedbacl< 
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Behavioural 


>Project Friend 


>Team beiiaviours 


>Evaluation approacii 


>The Alliance Capability Toolkit (ACT) 
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Objectives of the Project Friend Assignment 

Objective 1 : To design and implement a process for the 
selection of an Integrator based on their alliancing 
culture in its broadest interpretation, i.e. The ACT. 

Objective 2 : To help the IPT develop its knowledge of 
alliancing and thinking around the MARS alliance 
construct 

Objective 3 : To help develop the MARS IPT's internal 
capabilities and culture to increase its ability to be an 
effective alliance partner. 
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ACT Design Principles 



> Main Principle : The assessments were focussed on what 
the Potential Integrators (Pis) do, not what they say 

> Hence, it was up to each Pi's to demonstrate their 
capability by showing us the evidence . . . 

> & they would be able to have 3 goes at it. 

> Following any validation / assessnnent of the Pis own 
submission, there is an initial categorisation of 
Capability for each attribute. 

> Having assessed all three, the Independent Assessment 
Team (lAT) would conduct a comparative analysis, with 
final scores based on that comparison. 
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> What was the ACT to be used for ? 

> As the Assessment Tool to evaluate each of the 
Potential Integrators (Pis) over the Continuous 
Assessment (CA) Phase, including the degree of 
improvement. 

> This would determine 60%of their total marks. 

> It was also intended to be used to do an internal 
assessment of the IPT to develop a Management Plan 
for their development over the CA Phase. 

> It was therefore to be both an Assessment & a 
Development Tool. 
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Orignsof theACT 



> Advance had previously been commissioned by UK 
Highways Agency to develop the Capability Assessment 
Toolkit (CAT) & run the programme of assessments. 

This was an organisational evaluation tool, derived 
from the EFQM^'s Business Excellence Model. 



'^ EFQM =European Foundation for Quality ivianagement 
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Origins of the ACT 



> Advance had previously been commissioned by UK 
Highways Agency to develop the Capability Assessment 
Toolkit (CAT) & run the programme of assessments. 

> This was an organisational evaluation tool, derived 
from the EFQM'^'s Business Excellence Model. 

> While CAT was success, because it categorised 
performance on an ascending scale, by the end of the 
2"^ round, there was plateau' I ng at the top end as 
organisations "^ticked "^ the criteria at each level. 

* EFQM = European Foundation for Quality Managennent 



More on the Business Excellence Model 

in evaluating perfornnance in each of the Enabler boxes, 
we use a RADAR, where : 

R i s for Resu l ts : what arc you try i ng to ach i ovo ? 

A is for Approach : what needs to be improved or 
changed to achieve the desired Results ? 

Dis Deployment : how well are you deploying the 
selected Approaches ? 

>^is for Assessment : how do you know the benefit 
arising from this Deployment ? 

> R\s for Review : how do you review and improve what 

you have done ? 
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Model 4 Project Excellence - Results 
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Key 

Project 

Objectives: 

Statements 

of 

-Function 

- Quality 

- Time 

- Financial 
-H&S 

- Feelings 




Society & 
End User 










Employer 










Commercial 
Organisations 










Project 
Participants 





~ Minimum Disruption 
~ Better Functionality 
~ Improved Environment 



~ Functional 

~ End Quality / Maintainability 

~ Value for Money 

~ Enhanced Reputation 

~ Minimum Defects 
~ Profit 

~ Customer Satisfaction 
~ Repeat Business 
~ Enhanced Reputation 

~ Personal Development 
~ Health & Safety 
~ Feelings about Project 
during and after 
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Model 4 Project Excellence - Enablers 



Leadership 

& 
Governance 

- Setting direction 

- Governance, inc 

Performance 
IVIanagement 

- Communication 
(talking the talk) 

- Setting the 

Example 
(walking the talk) 



People 

- Selection 
Skills (hard & soft) 
■ Teamwork values 



Strategy 

Initiatives for 
- Project type / risk 
Cont improvement 



Partnerships 

- Selection 
- Incentivisation 
- Relationship 



Internal 
Resources 

- financial 
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Practices 
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The AC Toolkit 

^ Four Attribute Heading 

^ Leadership and Governance 

> Strategy & Planning 

> People 

> Collaborative Working and Processes 

> 18 Capability Statements 

> Scoring Table 

> 3 Self Assessment Proformas per Capability Statement 

> 3 Assessment Feedback Proformas per Capability Statement 

> Summary Scoring Sheet 
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ATTRIBUTE 1 
Leadership & Governance 



CAPABILITY 1.1 

Our leaders are personally and directly involved in the development of the vision, 
mission and agreed objectives to ensure a successful Alliance. They are 
communicated to everyone, in order to set the appropriate direction for the 
Alliance. 

CAPABILITY 1.2 

Our leaders are personally and directly involved in the development of the values 
and attendant behaviours and a corresponding framework to measure the culture of 
the Alliance. They develop the appropriate supportive culture by acting as 
champions and role models. 

CAPABILITY 1.3 

Our leaders continually encourage members to develop opportunities for improving 
the agreed outcomes. They personally sponsor the development, review and 
improvements identified tlirough a clearly defined and agreed performance 
management system in order to bring about continuous improvement and ensure 
sound governance. 

CAPABILITY 1.4 

The key governance and management roles and responsibilities are clearly defined, 
agreed and communicated by leaders of the Alliance. 
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ATTRIBUTE 2 



CAPABILITY 2.1 

We continually develop, deploy and monitor strategy and plans 
based on clearly identified anci agreed Critical Success Factors *. 

CAPABILITY 2.2 

We base the review and update of strategy and plans on the 
current and future needs, expectations and aspirations of all 
stakeholders through feedback and communication. 

CAPABILITY 2.3 

We communicate our strategy and relevant plans through a 
framework of key processes, which are owned and defined by our 
leaders. 



* Critical Success Factors : The critical elements of the strategy in terms of what has 
to be done to deliver the objectives. 
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ACT 



ATTRIBUTE 3 

Peoi 



CAPABILITY 3.1 

We select, recruit and induct people using a process that is shared, 
coordinated and aligned to the needs and aspirations of the Alliance. 

CAPABILITY 3.2 

We establish, develop, sustain and continually review people's 
competencies to ensure they are in line with the needs and aspirations of 
the Alliance. 

CAPABILITY 3.3 

We ensure that people are clearly mandated, sufficiently competent and 
have the capacity to achieve agreed obj ectives. 

CAPABILITY 3.4 

We develop and deploy a communication strategy to gain the commitment 
of our people which involves them in securing in the needs and aspirations 
of the Alliance. 

CAPABILITY 3.5 

We recognise and reward people for the contribution they make. 
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A QT 3 ATTRIBUTE 4 

f?^^.E«atu,,™LK.l Collaborative Working & Processes 3- 



CAPABILITY 4.1 

We align our objectives to address the drivers, constraints and needs of our 
stakeholders. 

CAPABILITY 4.2 

We select, manage, develop, support and integrate our supply chain to deliver the 
needs and aspirations of the Alliance. 

CAPABILITY 4.3 

We manage, develop and maintain collaborative relationships between ourselves 
and other Alliance members. 

CAPABILITY 4.4 

We manage, develop and maintain collaborative relationships with our other 
external stakeholders to meet the needs and aspirations of the Alliance. 

CAPABILITY 4.5 

We adopt and develop best practice processes to meet the needs and aspirations of 
the Alliance. 

CAPABILITY 4. 6 

We collect, collate and share information and knowledge to meet the needs and 
aspirations of the Alliance. 
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7F Summary UctUtt mtri 
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A. Baseline self-assessment by 1 1 MARS CA Scope of Work 1 
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How the MARS CA 

Scope of Work & 

Scoring Mechanism 

and 

ACT fit together 
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B. Validation by Project Friend leading 
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Capabilities during CA 




MARS IPT to develop 
answersto CD's model 
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Potential Integrator 
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C2. Development of 

Capabilities during CA 

Phase 




D2. Interaction with 
MARS IPT to develop 
answersto CD's model 
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by IPT 



The MARS V-GRIP Questionnaire 

V-GRIP stands for on a scale of l to 10, to what extent 

> Values 



> Goals 

> Roles 

> Interpersonal 

> Procedural 
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were the organisation's and alliance values 
reflected in the way they behave 

..did the m eeting activities dem onst rate a ciear 
ocus & understanding of its purpose and go a is 

.. w ere tiie roies & responsibiiities ciear, w itii 
acti team member understanding what was 
xpected of him/her 

.. w ere issues and d iffe re nces addressed openiy 
nd in a positive and constructive ciim ate 

.. w ere the m eetings structure, ground ruies and 
rocedures ciear and appiied by aiiteam members 
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The MARS V-GRIP Questionnaire 

> This, plus written evidence, gave an audi table 
score out of 50. 

> This, plus conversations with those IPT members 
who interacted with the PI, were taken into 
account by the Independent Assessment Team. 

> The Pis were also expected to give feedback to 
the IPT using the V-GRIP questionnaire and feed 
this back through their Project Friend. 
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ACT Design Principles Revisited 

> Main Principle : The assessments were focussed on what 
the Potential Integrators (Pis) do, not what they say 

> Hence, it was up to each Pi's to demonstrate their 
capability by showing us the evidence . . . 

> & they would be able to have 3 goes at it. 

> Following any validation / assessnnent of the Pis own 
submission, there is an initial categorisation of 
Capability for each attribute. 

> Having assessed all three, the Independent Assessment 
Team (lAT) would conduct a comparative analysis, with 
final scores are based on that comparison. 

> CHECK : Do people now understand what these mean in 
'W\rM6o P^^^tice? 'advance 



Lessons Learnt wit Objective 1 

1: Increased Development Time for the ACT Model & 
Process 

2: Some Improvements to the ACT Model & Process 

3: The Project Friends time allocated to each Potential 
Integrator and the IPT 

4: Selection of complementary Project Friend Teams and 
Independent Assessment Team members. 

5: striking the Right Balance between the independence 
of each Project Friend team and overall co-ordination. 
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> Any Questions 
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